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(57) An enhanced video special effects system 
architecture is based on deinteriacing (16) in- 
coming fields of interlaced video and proces- 
sing the deinteriaced video through video 
special effects operations (18,30). each of which 
benefits from operating on a progressive scan 
video signal rather than an interlaced video 
signal. 
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Background of the Invention 

This invention relates to television special effects, 
and more particularly to an improved architecture for 
a television special effects generator. 5 

A video image is usually recorded or displayed by 
sweeping an electron beam horizontally across the 
face of a camera tube or a picture tube a number of 
times, from top to bottom, before a vertical retrace is 
accomplished and the procedure is repeated. The io 
pattern of lines on the face of a camera or picture tube 
is called a "raster". If the image is created by horizon- 
tal lines that are immediately adjacent each other and 
incrementing downward monotonically, it is known as 
progressive raster scanning or non-interiaced video. is 

However, to reduce the bandwidth required for 
the transmission of the image data while preserving 
as much resolution as possible, commercial television 
standards make use of a technique known as "inter- 
lace scanning". In this approach, a complete frame of 20 
video with full resolution is made of two consecutive 
fields, each with half as many lines, such that the lines 
of one field fall between those of the other field. One 
of these two fields contains, in effect, all of the odd 
lines of a normal frame of video, while the other con- 25 
tains all of the even lines. The two interlaced fields 
create an image wifii an effective sampling rate that 
is lwic0 that of each field separately, and therefore for 
a given bandwidth^ the vertical resolution is doubled 
relative to each of them separately. 30 

Effective as they are at conserving bandwidth 
while preserving resolution, interlaced television 
video signals present a number of problems in mod- 
ern digital television special effects equipment. A var- 
iety of video special effects can cause apparent 35 
motion that creates a problem in connection with inter- 
laced video. These include synthetic light reflections, 
adding borders, defocus effects, key glow generation 
and mosaic tiling. In each of these operations, appa- 
rent motion is introduced into the video image and this 40 
apparent motion shows up as undesirable artifacts if 
the interlaced fields are operated on independently of 
each other 

Higher quality video special effects systems 
attempt to use the information from two or more fields 45 
to create output images and thus produce images that 
utilize the full resolution capability of the interface 
standard. To avoid distortions produced by motion or 
apparent motion, these systems adaptively switch be- 
tween full frame and single field operation, depending so 
on whether motion is detected locally on a pixel by 
pixel basis. 

U. S. Patent 4,472.732 to Bennett et al for a "Sys- 
tem for Spatially Transforming Images", hereby incor- 
porated by reference, discloses a video special 55 
effects system that includes two deinterlace filters 
(600 and 902. FIG. 3), only one of which is used In a 
particular transfomriation. These filters (described 



with reference to FIG. 18 of that patent) include 
motion detection on a pixel-by-pixel basis that is used 
to determine the content of an output frame. Motion is 
detected by comparing a pixel's Y, I and Q values in 
a most recent field with the values two fields earlier. 
If these values differ by more than a threshold 
amount, a motion signal is generated. In the absence 
of this motion signal, in generating a deinterlaced 
frame output, the same pixel on the next line will have 
its value determined by the next most recent field of 
interlaced video. However, in the presence of this 
motion signal, the value of the same pixel on the next 
line is based on the average of the pixels above and 
be low it in the most recent field. Thus, this deinterlace 
filter produces a progressive scan frame of video in a 
manner that adaptively filters out field -to-field motion. 

In the architecture described in U, S. Patent 
4,472,732, the deinterlaced output of the deinterlace 
filter is filtered and then used immediately in an inter- 
polation process that produces an interlaced output 
again. 

Summary of the Invention 

The quick reversion to interlaced video fields 
taught by U. S. Patent 4,472.732 has the advantage 
of reducing bandwidth requirements of the video spe- 
cial effects generators that are downstream from the 
interpolation process. However, by reverting to inter- 
laced fields again so quickly, a major opportunity for 
an enhanced video special effects system architec- 
ture is missed. 

According to the present invention, an enhanced 
video special effects system architecture is based on 
deinterlacing incoming fields of interfaced video and 
keeping the video deinterlaced as it is processed with 
video special effects operations that each benefit from 
operating on a progressive scan video signal, rather 
than an interlaced video signal. 

The subject matter of the present invention is par- 
ticularly pointed out and distinctly claimed in the con- 
cluding portion of this specification. However, both the 
organization and method of operation, together with 
further advantages and objects thereof, may best be 
understood by reference to the following detailed des- 
cription and accompanying drawing. 

Brief Description of the Drawing 

The FIGURE is a block diagram of the progress- 
ive scanning section of a video special effects system 
according to the present invention. 

Detailed Description 

Referring now to the FIGURE, an interlaced digi- 
tal video signal input is applied to a frame buffer 10 
containing two one-field delay elements 12 and 14. 
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The frame buffer 10 presents three frames of video to 
the motion detect deinteriace interpolator 16, field,ast. 
field,ast-i and fie!d|ast-2- 

The motion detecting deinteriace interpolator 16 
suitably operates as described in U. S. Patent 
4,472,732 to Bennett et al, previously incorporated by 
reference, to produce a progressive scan video signal 
output. 

The progressive scan video signal is then proces- 
sed by two blocks of video special effects 18 and 30 
and anti-aliasing filtered horizontally 28 and vertically 
38. Within the first block of video special effects 18, 
the progressive scan video is applied first to a simu- 
lated lighting generator 20. Simulated lighting gener- 
ation is known in the art, and a suitable method of 
perfonning this function is described in U. S. Patent 
4,899.295 to Nonweiler for "Video Signal Processing", 
hereby incorporated by reference. 

The output of the simulated lighting generator 20 
is applied to the input of borders generator 22. Bor- 
ders generation is well known to those of ordinary skill 
in the video arts and is described in U. S. Patent 
4,698.666 to the present inventor for "Video Key Glow 
and Border Generator", hereby incorporated by refer- 
ence. 

The output of the borders generator 22 is applied 
to the input of horizontal mosaic sampler 24. Mosaics 
samplers are known in the art and a representative 
one is described in U. S. Patent 4,782,398 to the pre- 
sent inventor for "Method and Apparatus for Providing 
Video Mosaic Effects", hereby incorporated by refer- 
ence. 

The output of the horizontal mosaic sampler 24 is 
applied to the input of horizontal defocus filter 26. 
Defocus filtering is well known to those of ordinary 
skill in the video arts, and merely consists of extreme 
low pass filtering. 

The output of the horizontal defocus filter 26 is 
applied to the input of horizontal anti-aliasing filter 28. 
Anti-aliasing fitters are known in the art, and a suitable 
one is described in U. S. Patent 4,703,447 to the pre- 
sent inventor for "Mixer Controlled Variable Passband 
Finite Response Filter", hereby incorporated by refer- 
ence. The output of the anti-aliasing filter 28 is then 
stored in column scanning memory 32. 

The column scanning memory 32 re-orients the 
pixel transfer sequence from a horizontal scanning 
order to a vertical scanning order. The "transposing 
memories" described in U. S. Patent 4,472,732 to 
Bennett et al, previously incorporated by reference, 
suitably perform this function. 

As it is read out of the column scanning memory 
32, the partially processed progressive scan video 
signal is sequentially applied to a vertical mosaic sam- 
pler 34, a vertical defocus filter 36 and a vertical anti- 
aliasing filter 38. 

As this progressive scan video signal stream is 
processed through the blocks above, the bandwidth 



requirements for each of those blocks is doubled. As 
each of these blocks has been explained by reference 
to a prior art patent or by being described as "well 
known to those of ordinary skill in the video art", it 

5 should be borne in mind that some adaptation will be 
required to handle twice as much data. Whether this 
can most effectively be done by doubling the width of 
the data path or by using faster parts and doubling the 
speed of the data path, will depend on price tradeoffs 

10 and practical considerations in the local design envi- 
ronment. 

The fully processed progressive scan video sig- 
nal is then put in either a frame 1 memory 44 or a 
frame 2 memory 46, which together constitute a trans- 

15 form memory 40. 

A write address generator 42 receives sync signal 
inputs and produces the addresses that write the fully 
processed progressive scan video signals into the 
transfom memory 40. The sync signal inputs to the 

20 write address generator 42 have been used and 
delayed appropriately by each of the blocks 20-38 
along the video processing path. Each block receives, 
uses and appropriately delays these sync signals, so 
that blocks downstream are unaffected by design 

25 changes or operating mode changes in the blocks that 
are upstream from them. 

The output sync generator 48 receives output 
sync references and the delayed input sync signals 
accompanying the video. It needs the latter in case 

30 the output sync references are not present for some 
reason and it is necessary to use the delayed input 
sync signals instead. It is also necessary to measure 
the relative timing difference between the delayed 
input video sync signals and the output sync refer- 

35 ence. While some time is available to compensate for 
timing differences, if the measured difference is larger 
than the maximum time available for this purpose, it 
is necessary to detect that condition and notify the 
operator. 

40 The output sync generator 48 supplies the read 

address generator 50 with output sync signals. The 
read address generator 50 produces read addresses 
according to the desired transfomi function, such as 
sizing, positioning, rotation, perspective, projection. 

45 warping, etc., and supplies the integer part of these 
pixel addresses to the transform memory 40. The frac- 
tional parts of these addresses are supplied to the 
interpolator 52. The read address generator 50 reads 
from the opposite frame 1 or 2 memory 44, 46 from the 

50 one that is presently being written to by the write 
address generator 42. The synchronization of the 
writing and reading of the two frame memories 44 and 
46 is maintained by the vertical blanking signal which 
identifies the end of a field and causes the alternation 

55 between reading and writing of the two frames. Inter- 
lacing is reintroduced in this reading out process. 

Although not shown in the FIGURE, key glow fil- 
tering may be accomplished in a separate parallel 
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channel, as described in U. S, Patent 4.698,666 to the 
present inventor for "Video Key Glow and Border 
Generator", previously incorporated by reference. 

While a preferred embodiment of the present 
invention has been shown and described, it will be 
apparent to those skilled in the art that many changes 
and modifications may be made without departing 
from the invention in its broader aspects. The claims 
that follow are therefore intended to cover all such 
changes and modifications as fall within the true 
scope of the invention. 
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mosaic tiling generator (24,34). 

A method for producing video special effects 
according to claim 4 further comprising the step 
of anti-aliasing filtering (28,38). 



Claims 

1. A video special effects system comprising: 

a deinterlace filter (16) with motion detec- 
tion for producing a progressive scan video signal 
output from an interlaced video input; 

video special effects generating means 20 
(18.30) for operating on the progressive scan 
video signal to produce a progressive scan video 
signal with special effects; and 

means for interiacing (52) the progressive 
scan video signal with special effects to produce 25 
an interiaced video signal with special effects. 

2. A video special effects system according to claim 
1 wherein the video special effects generating 
means (18,30) comprises one of the following: 30 

simulated lighting generator (20); 
borders generator (22); 
defocus effects generator (26,36); and 
mosaic tiling generator (24,34). 

35 

3. A video special effects system according to claim 
1 further comprising means for anti-aliasing filter- 
ing (28,38). 

4. A method for producing video special effects, the 40 
method comprising the steps of: 

deinterlace filtering (1 6) with motion detec- 
tion an interlaced video input to produce a pro- 
gressive scan video signal output; 

applying a video special effect (18,30) to 45 
the progressive scan video signal to produce a 
progressive scan video signal with special 
effects; and 

interiacing (52) the progressive scan video 
signal with special effects to produce an inter- so 
laced video signal with special effects. 

5. A method for producing video special effects 
according to claim 4 wherein the video special 
effect (18,30) comprises one of the following: 55 

simulated lighting generator (20); 

borders generator (22); 

defocus effects generator (26,36); and 
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